a many-facet rasch measurement of bias among farsi-native speaking raters toward essays written by non-native speakers of farsi

Authors

رجب اسفندیاری

استادیار گروه مترجمی زبان انگلیسی- دانشگاه بین ‏المللی امام خمینی(ره)

abstract

in this study, we investigated the errors native speakers of farsi commit when rating the esl essays, using a many-facet rasch measurement approach. to that end, two native speakers of farsi rated 56 essays which 28 male and female advanced language learners learning farsi as a second language at persian language centre at imam khomeini international university in qazvin, iran wrote on two topics in winter 2014. the raters rated the language learners' essays, using a researcher-made, 5-point analytic rating scale. we analyzed the collected data, using facets. the results of facets analyses showed that raters showed bias towards both topics. the results also revealed raters’s bias towards only coherence. statistically significant differences were found in raters’ bias towards essays. the findings suggest that raters should be provided with strict guidelines to rate accurately and consistently. the findings can shed light on rater training to reduce the errors raters may commit.

Upgrade to premium to download articles

Sign up to access the full text

Already have an account?login

similar resources

judgments of ielts writing task ii by non-native and native english speaking teacher raters :an outlook on inter-rating variability

abstract i the purpose of this study was to launch a thorough investigation concerning the possibility of differing orientations to the writing proficiency construct by native and non-native english speaking teacher raters. it mainly revolved around the international english language testing system (ielts) that is widely administered and employed as a measure of general proficiency in englis...

15 صفحه اول

"C u @ d Uni": Analysis of academic emails written by native and non-native English speakers

The present study examined email communication practices of two groups of students in Iran and the United States to uncover the probable differences between Iranian and American email communication norms. The study also aimed at investigating how power distance in academic centers influences students’ choices of communication strategies in email writing. The use of two politeness strategies nam...

full text

A Corpus-based Analysis of Epistemic Stance Adverbs in Essays Written by Native English Speakers and Iranian EFL Learners

Academic essays entail taking a stance on the truth value of propositions. Epistemic adverbs deal with the speaker's assessment of the truth value of propositions. Employing a corpus-based approach with descriptive statistics and qualitative description, this study explored the use of epistemic stance adverbs in academic essays written by native English speakers and Iranian EFL learners. Follow...

full text

Many-Facet Rasch Measurement

This chapter provides an introductory overview of many-facet Rasch measurement (MFRM). Broadly speaking, MFRM refers to a class of measurement models that extend the basic Rasch model by incorporating more variables (or facets) than the two that are typically included in a test (i.e., examinees and items), such as raters, scoring criteria, and tasks. Throughout the chapter, a sample of rating d...

full text

Rater Errors among Peer-Assessors: Applying the Many-Facet Rasch Measurement Model

In this study, the researcher used the many-facet Rasch measurement model (MFRM) to detect two pervasive rater errors among peer-assessors rating EFL essays. The researcher also compared the ratings of peer-assessors to those of teacher assessors to gain a clearer understanding of the ratings of peer-assessors. To that end, the researcher used a fully crossed design in which all peer-assessors ...

full text

Speaking rate consistency and variability in spontaneous speech by native and non-native speakers of English

The suprasegmental characteristics of non-native speech are generally described as differing from those of native speech. Recent work has shown that in addition to speaking at overall slower rates, non-native speakers in a reading task are more variable than native speakers in their speaking rate across utterances [1]. However, read speech may contain sources of variability that are specific to...

full text

My Resources

Save resource for easier access later


Journal title:
پژوهشنامه آموزش زبان فارسی به غیر فارسی زبانان

جلد ۳، شماره شماره سه ( پیاپی ۸)، صفحات ۲۵-۵۴

Keywords
[ ' i n t h i s s t u d y ' , ' w e i n v e s t i g a t e d t h e e r r o r s n a t i v e s p e a k e r s o f f a r s i c o m m i t w h e n r a t i n g t h e e s l e s s a y s ' , ' u s i n g a m a n y ' , ' f a c e t r a s c h m e a s u r e m e n t a p p r o a c h . t o t h a t e n d ' , ' t w o n a t i v e s p e a k e r s o f f a r s i r a t e d 5 6 e s s a y s w h i c h 2 8 m a l e a n d f e m a l e a d v a n c e d l a n g u a g e l e a r n e r s l e a r n i n g f a r s i a s a s e c o n d l a n g u a g e a t p e r s i a n l a n g u a g e c e n t r e a t i m a m k h o m e i n i i n t e r n a t i o n a l u n i v e r s i t y i n q a z v i n ' , ' i r a n w r o t e o n t w o t o p i c s i n w i n t e r 2 0 1 4 . t h e r a t e r s r a t e d t h e l a n g u a g e l e a r n e r s & a p o s ; e s s a y s ' , ' u s i n g a r e s e a r c h e r ' , ' m a d e ' , 5 , ' p o i n t a n a l y t i c r a t i n g s c a l e . w e a n a l y z e d t h e c o l l e c t e d d a t a ' , ' u s i n g f a c e t s . t h e r e s u l t s o f f a c e t s a n a l y s e s s h o w e d t h a t r a t e r s s h o w e d b i a s t o w a r d s b o t h t o p i c s . t h e r e s u l t s a l s o r e v e a l e d r a t e r s s b i a s t o w a r d s o n l y c o h e r e n c e . s t a t i s t i c a l l y s i g n i f i c a n t d i f f e r e n c e s w e r e f o u n d i n r a t e r s b i a s t o w a r d s e s s a y s . t h e f i n d i n g s s u g g e s t t h a t r a t e r s s h o u l d b e p r o v i d e d w i t h s t r i c t g u i d e l i n e s t o r a t e a c c u r a t e l y a n d c o n s i s t e n t l y . t h e f i n d i n g s c a n s h e d l i g h t o n r a t e r t r a i n i n g t o r e d u c e t h e e r r o r s r a t e r s m a y c o m m i t . ' ]

Hosted on Doprax cloud platform doprax.com

copyright © 2015-2023